Gradient free descent: shadowing, and state estimation using limited derivative information
نویسندگان
چکیده
Shadowing trajectories can play an important role in assessing the reliability of forecasting models, they can also play an important role in providing state estimates for ensemble forecasts. Gradient descent methods provide one approach for obtaining shadowing trajectories, which have been shown to have many useful properties. There remains the important question whether shadowing trajectories can be found in very high-dimensional systems, like weather and climate models. The principle impediment is the need to compute the derivative (or adjoint) of the system dynamics. In this paper we investigate gradient descent methods that use limited derivative information. We demonstrate the methods with an application to a moderately high-dimensional system using no derivative information at all. © 2003 Elsevier B.V. All rights reserved. PACS: 92.60.Wc; 05.45
منابع مشابه
A guide to using shadowing filters for forecasting and state estimation
Most traditional, and many modern, methods of state estimation have a number a failings when applied to high-dimensional and nonlinear systems. A promising new alternative that avoids many of these failings is a shadowing filter. An additional advantage of shadowing filters is that when combined with indistinguishable states they provide a consistent generalisation to the imperfect model scenar...
متن کاملShadowing Pseudo-Orbits and Gradient Descent Noise Reduction
Shadowing trajectories are one of the most powerful ideas of modern dynamical systems theory, providing a tool for proving some central theorems and a means to assess the relevance of models and numerically computed trajectories of chaotic systems. Shadowing has also been seen to have a role in state estimation and forecasting of nonlinear systems. Shadowing trajectories are guaranteed to exist...
متن کاملMaximum Likelihood Parameter Estimation in General State-Space Models using Particle Methods
A large number of time series can be described by nonlinear, non-Gaussian state-space models. While state estimation for these models is now routinely performed using particle filters, maximum likelihood estimation of the model parameters is much more challenging. In this paper, we present new numerical methods to approximate the derivative of the optimal filter. We use this to perform batch an...
متن کاملLocation and dimensionality estimation of geological bodies using eigenvectors of "Computed Gravity Gradient Tensor"
One of the methodologies employed in gravimetry exploration is eigenvector analysis of Gravity Gradient Tensor (GGT) which yields a solution including an estimation of a causative body’s Center of Mass (COM), dimensionality and strike direction. The eigenvectors of GGT give very rewarding clues about COM and strike direction. Additionally, the relationships between its components provide a quan...
متن کاملRandomized Similar Triangles Method: A Unifying Framework for Accelerated Randomized Optimization Methods (Coordinate Descent, Directional Search, Derivative-Free Method)
In this paper, we consider smooth convex optimization problems with simple constraints and inexactness in the oracle information such as value, partial or directional derivatives of the objective function. We introduce a unifying framework, which allows to construct different types of accelerated randomized methods for such problems and to prove convergence rate theorems for them. We focus on a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2004